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Abstract! A new system is described for attaching many responsive graphical display consoles to a 
BLi^Ie multi-access central computer. The key coniponent in this system is a new console, the 
GRAPHIC-2, The console includes a small general purpose computer and a specially designed dis¬ 
play processor. Only low banciwidth comimmicatlon is required between the central comptrter and a 
console so a console can be located remotely and connect^ via a voice-grade line. Combined tiard- 
ware-'Software solutions to problems of the console system are presented* 


INTRODUCTION 

Two pioneering systems, DAC-I (1) and 
Sketchpad have demonstrated the etfectiye- 
ness and desirability of gr^hical input-output 
computer communication via a cathode-ray tube 
display console. Since the advent of these sin¬ 
gle console systems, work has been going <m to 
d^ign configiirations that allow an increased 
number of consoles to be attached to a Large 
central computer, minimize the hardware and 
□peraling costs of each console, and allow re¬ 
mote location of consoles from the computer. 
The constraints generally applied to this work 
have been that a user at each console should 
possess at least the problem-solving power and 
response times to ir^^ut device manipulMions 
provided by the early systems. Under these 
constraints configuration design has indeed been 
difficult. 

Ail early configuration was the attachment of 
several consoles to a large time-shared com¬ 
puter {3,4). The CRT^s were refreshed and 
console ii^ut devices were monitored by the 
computer. The direct connection of even a 
single console, however, caused excessive 
qperatic^ expense for picture refreshing. The 
time-shying system provided slow resiionses 
to console Input device manipulatione. During 
console usage, degradation of service to other 
computer system u^ere also resulted (5). 

In a later configuration, multiple consoles 
were attached through a controller to a com¬ 
puter. The controller stored pictures received 
from the computer on a drum memory and re¬ 
freshed picture without further computer aid. 
Console input devices were monitored try the 
computer. Dynamic subroutine loading and 
memory management were used to allow several 
consoles to be served concurrently. With this 
organization, three consoles were successful^ 
attached (6). However, for this number, total 
dedication of the computer was required, and 
actions at one console interfered with r^ponse 
times at others. Remote console loeation be¬ 
yond a few hundred feet from the con3puter was 
not possible. 

A third approach was to interpose a small 
general purpose computer between the central 
computer and the display console (7, 8). The 
small computer, located at the display console, 
provided rapid responses to console ii^ut 


device manipulations and refreshed the picture 
out of its memory. It also accummulated work 
It could not perform for subsequent action by 
the central computer and supervised com¬ 
munications back and forth between the console 
and the central computer. The central com¬ 
puters were operate In batch mode with con¬ 
sole access between batch Jobs. The size of 
the problem that could be solved at a console 
was usually limited by what could be contained 
in the console memory at one time. For 
larger problems, the slow response to requests 
to i;q:>date the console-contained piece of the 
problem made problem solving difficult. For 
these satellite systems, the central computer 
was totally dedicated during the batch sl^ 
allocated to a console so that high data trans¬ 
fer rates between the console and the central 
computer were desirable* Thus, these sys¬ 
tems had to be located close to the centr^ 
computer to achieve reasonable communica¬ 
tions costs* 

THE GRAPHIC-2 SYSTEM ORGANIZATION 

Based on experience with the GRAPHIC-1 
console system (7) (which is of the type des¬ 
cribed in the previous paragraph) and on a rec¬ 
ognition of the problems of the other systems 
just outlined, a new display console system 
has been created. SjjecificaUy, the system 
consists of several satellite GRAPHIC-2 con¬ 
soles attached to a large multi-access com¬ 
puter, Satisfactory performance is achieved 
with only voice-grade communication service 
(2000 baud) between the large computer and 
each console. Each console contains a small 
computer and a display; the configuration is 
shown in fig. 1, The multi-access central 
conputer currently ia a GE 845 operating 
under the GECOS-H system. 

The overall cooperative cperation of a 
GRAPHIC-2 console and the central computer 
can be summarized as follows: The central 
computer contaius a structured data base 
which describes a problem. The console 
computer also has a structured data base, the 
two data bases being similar though not 
identical. For example^ greater precision in 
the storage of numbers and different linking 
conventions are used centrally, S^arate 
programs reside in the central and console 
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Fig, 1 GRAPMIC-2 SYSTEM OHGANlZATrON 

computers to d«al with this structured Informa¬ 
tion, These programs have been assembled 
from a single problem description* The pro- 
grams differ In detail but cooperate to execute 
the comnion problem. The operation of these 
programs is carefully interlocked, 

A user starts a problem by employing a 
bootstrap program to call for data and programs 
to be loadecf from the central con^uter into the 
console core memory. Of course^ if a problem 
is being formulated bttle or no Initial data may 
exist. "The user then employs the console irput 
devices to work on his problem. Through an 
internet-driven monitor, the console computer 
acts on signals received from the devices to 
direct control to appropriate servicing programs 
which quickly perform most manipulations on the 
data. The display immedLately reflects these 
manipulations so that a user has rapid visual 
feedback of his actions. 

A history of console actions is transmitted 
to the central con^uter where the manipulations 
specified by the history are duplicated by the 
centraJ coinputer program on the central data 
base. Because of this duplication, the history 
Is highly encoded, i. e,, it contains only end¬ 
point information of involved operations* A 
user has already received rapid response from 
the console computer * bo there is generally no 
need lor tiie central con^uter to act rapidly on 
this history. It can be transmitted to and pro¬ 
cessed by the central computer in small blocks 
as aprc^lem is being worked on. Hence^ much 
less information with less stringent response 
time demands passes from a G:^PHIC-3 con¬ 
sole to the central computer as compared with 
a directly coupled console to Its supporting com¬ 
puter and low bandwidth transmission to the 
central computer Is satisfactory* 


While the composition and editing of problem 
data can be easily haidled by the console com¬ 
puter, large scale processing cannot* Large 
processing taakSp such as computing the fre¬ 
quency or time response of a circuit condosed 
at the console, are directed to the central com¬ 
puter, The results of central computations are 
transmitted to the console for display aid/or 
further work. Since the large scale computa¬ 
tions usually take significant time, the extra de¬ 
lay caused by transmitUi^ It over low bandwidth 
lines is not noticed by a console user {9), There- 
fore, low bandwidth communication is also 
1 satisfactory for transmission to the console* 
Hence, a console can be located remotely a’ld 
connected to the central con$iuter via an eco¬ 
nomical dialed-up voice-grade line. 

The size of the memory in the GIlAPHlC-2 
is limited. Therefore, provision is made to 
deal with an appropriate piece of a problem ff 
the problem is too large to fit totally into the 
console at one time (10)* The console thus r^- 
resents a dynamic window on a lar^e problem 
surface* This dynamic quality is essential 
because, in man-computer problem solving^ the 
course of action is man-directed (11). This 
Course cannot be anticipated, so provision must 
be made for the problem to follow the man's 
directions. 

In review, the GRAPHIC-2 system operation 
is, in most cases, one of duplicate processing. 
Tasks requiring rapid response are done when¬ 
ever possible by the console computer* These 
same tasks are performed in the central com¬ 
puter, along with more complex tasks. So, 
remote console location with low bandwidth con¬ 
nection has been achieved at the e^ense of the 
duplicate processing. However, the conBole 
re^-time tasks are treated in the central com¬ 
puter as blocked Inputs without stringeit re¬ 
sponse requirements* Mult^le consoles are 
thus easily aid efficiently handled by a central 
computer with a minimum of interference to 
other central computer users* 

Let us now look at some problems which 
have required special consideration In the 
GRAPHIC-a operation. As previously men¬ 
tioned, both the local computer and the cen¬ 
tral computer contain structured database. 
The ability to structure picture Information is 
an absolute necessity In any display console. 

If names mid hierarchical Interrelations cannot 
be represented and manipulated, the console 
user is severely limited in the problems he 
can attack. It might be mentloaed also that 
structured information goes hand-in-hand with 
organized user thought processes. Manipulat¬ 
ing and displaying structured information for a 
large problem is particularly difficult In a 
satellite console since memory space is lim¬ 
ited* 

A semi-'interpetlve mode oi operation of the 
graphic- 2 console which allows the direct 
display of the structured information is 
dependent upon special hardware features of 
the console* Before this inode is explained, 
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therefore, the console hardware wlU be des¬ 
cribed. 

THE GRAPfllC-2 CONSOLE 

The GRAPHTC“2 console is S sh^ed mem* 
OTf multi-processor. One processor is that of 
a small general purpase computer; the other^ 
a specially designed display processor^ The 
computer, a D* E. C* PDP*!! (12),^ houses the 
8^ 192 18'bit word memory which serves both 
processors. The PDP-9 ha.5 sla_idard in¬ 
put devices a teletypewriter, a paper tape 
reader and punch, and a 60 Hz interrupt clock. 
The interrupt clock is used during light pen 
tracking and for synchronizing frame repetit¬ 
ions. The other standard devices are used 
only for bootstrapping, i[naJnteiiaTiee,i and de¬ 
bugging. Options included on the coo^uter are 
a_i Ejdended Arithmetic Element, a Direct 
Memory Access ChaoEiel Multiplexor, and ai 
Automatic Priority Interrupt (API) system. 

The display processor controls a slightly 
modified D. E. C. Type 343 Slave CRT Display. 
The method of picture formation is incremental 
point plotting on a 1024x1024 matrix. Lanes 
aid characters are formed from closely spaced 
points Thus, the display can be classed aa a 
dot scope, as opposed to a strt4te-vector scc^e 
in which lines are swept out. 

Console input devices are a light pea a-i 
ASCII-code k^board (full seven-bit code), aid 
eight pushbuttons. The selection of this set is 
based qion experience obtained an the 
GRAPHIC-1 console. The Small number of 
devices is possible because, with a lood pro ¬ 
gramming sy ste nij the light penTs" e^fremefy 
flexible. The display screen can be both a 
:ontrol and a iisplay surfa:e (13). Thus, the 
light pea cai serve both to indicate the flow of 
control when pointed at light buttoajg (control 
functions on the screen) or to siqsply arguments 
to aiy activated subprogram. A console is con¬ 
nected via V DATA-PHONE>i Data Set 20iA to 
the GE 645 system. 

The processor of the PDP-9 r esponds to 
iiput device signals to activate prograjns In the 
shared memory. In executing these programs, 
words are accessed from the memory^ the 
operation code and arguments are inferpretedj 
and the appropriate action such as an add^ 
shiftj. etc. is performed^ The display pro¬ 
cessor^ through the memory multiplexor, has 
"cycle stealing" access to the memory with 
higher priority than the coirputer processor^ 

It also accesses words from the memory, 
interprets the operation code and arguments, 
and performs the appropriate action. For the 
display processor these actions include dis¬ 
playing points^ lines, and characters on the 
console CRT* 

The PDP-9 processor and the display pro¬ 
cessor can operate Independently of one aaiother, 
the PDP-9 processor has control over the 
display, i, e, ^ it can start and stop the display 
processor. One computer command loads the 


contents of the accumulator into the display 
address register of the display processor aid 
sta_"ts the ^splay. Under internal controls, the 
displa/ proee«sor uses the display address reg¬ 
ister to sequence through display words from the 
shared memory, Aa each word is executed^ the 
display address register is Incremented aid the 
next word is fetch^. Thus, the display address 
register performs the function of the program 
counter In a lormal coneuter* The execution 
of sequeutia' words from memory is performed 
until the computer issues a stop command or 
until specially coded display words f display trs^ 
words) stpp the cycling aid signal the computer* 
This latter situation will be discussed In derail 
shortly. 

In addition to the inlormation channel From 
the shared memory to the display processor, 
there is a path from the computer accumulator 
to the display processor. This path is remin¬ 
iscent of the only data path in some early dis¬ 
play scopes a^ached to computers. The 
instructioTi codes which are used in the direct 
memory access path a^e also used here. The 
accumulalor-to-display pa'^h ^ under single step 
control, i.e.» the display halts aid a signal is 
passed ba:k to the computer when the aceum* 
tila-or-provided word has been completely ex¬ 
ecuted. The display address register is iiot 
chaiged during such actions. So, at the ^nd 
of a string of words from the accumulator, a 
ingle command cai restore normal cycling. 

The accumulator datapath may be Ui^ed in 
setting and restoring the display ataVs- It may 
a'so be used In performing rnterpr^ive function 
generation in which a display trap word stops 
normal cycling, interrupts the computer and 
provides functions generatioJi a'gumeats. The 
computer then uses the accumulator path to 
generate the function. Circles, arcs, or 
other cifTves cii be generated In this way with 
normal display cycling being resumed 
completion of the function. A data path from 
the display processor back to the computer 
accumulator is used to pass display processor 
stains ^mch as X aid Y coordinates back to the 
computer. 

The display -frocessor codes are shown in 
Fig. 2. tn some previous consol^s^ a bit 
configuration could mean different things de¬ 
pending on the display mode. This problem has 
been avoided by designing the displ^ code set 
with a separate operation code in each word. 
Thus,, each display word is treated indi^end- 
ently aid one can tell by merely examlniiig a 
single word whaf operation it will perform. 

A leaiii^ /*0'^ hit categorizes the word as 
a display primitive* The primitives f^ntrol 
the setting of display parameters, and the 
plotting of points, lines, aid characters. 
Characters are formed utillzir^ a dot matrix 
aiiproach. A specially designed character 
generator uses the computer memory to store 
a character font» The character code is com¬ 
bined with a pointer to address a dispatch 
table in the computer memory. The di^atch 
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Fig. 2. DTSPl^Y PROCESSOR CODES 

table entry is then used to access merement 
mode-like words which describe the character* 
A separate channel of the direct memory access 
multiplexor is employed. Double word buf- 
ferii^ Is used to mlnimiKe memory access 
waiting time. A user can compose and use any 
12fi character font he desires. No basic char¬ 
acter grid is enforced although a 5x:7 grid is 
normsilly used. The ASCII font is available as 
a programmed standard. The core space re¬ 
quired hy the ASCII font and dispatch table is 
456 words. 

Parameter^ absolute positioo^ and incre¬ 
ment word functlouB are fairly standard. One 
exception is the parameter word symmetry 
feature which transforms the tp* down, right, 
and left movement commanife from the vector, 
character, and increment generators» The 
first bit^ Ef exchanges the axes. K E is set, 
a right command becomes an up command, a 
left command becomes a down command, and 
vice versa. The second bit, complements 
the X direction movements. If set, it makes 
a right command into a left command and 


vice versa. The Cy stands for complement Y, 
and performs analogous functions to the bit. 
Combinations of exchange and complemeni can 
be used to pro^ce any of the symmetries of a 
square. 

Except for symmetiy, the condition bits in 
the parameter word Indicate whether the cor- 
respondi^ current parameter value is chained 
or remains the sarne^ For the Bymmetxy feat¬ 
ure* a in the condition bit here functions as 
for the other parameters. A ^"0'^ condition bit, 
however, means that the indicated symmetry 
transformation is concatenated with the current 
transformation to form a new symmetry trans- 
formation^ For example, il a +90* rotation is 
already set, concatenation with a ISO" rotation 
produces a +270* rotation. Thus^ the symmet¬ 
ry frature functions proper^ for nested graph¬ 
ical subroutines. 

Several options are provided In the drawing 
of vectors. The holding register for the spec¬ 
ified component may be loaded onfy. The hold- 
ii^ re^ster may be loaded and the vector, as 
specified by the current contents of both holdir^ 
roisters, drawn with or without beam inten¬ 
sification; both holding registers are cleared 
after vector execution. Alternately, the vector 
may be drawn with only the last point of the 
ve<^r intensified* This option gives a relative 
point capability. 

If the leading bit of a display word is 
the word is a display trap. Upon encotmierii^ 
a display trap word, the display processor 
stops and signals the console con^uter via the 
automatic priority interrupt* The second, 
third, and fourth bits of the display trap de^ 
termine which of eight transfer pointers In an 
internet transfer vector is used to direct con¬ 
trol to a program. Thus, eight programs can 
be quickly evoked by display trap words. Other 
pointers in the interrupt transfer vector are 
activated by signals from the light pen, push¬ 
buttons, keyboard, data phone, and di^lay 
processor* 

The display processor logic is pra&ent^ 
running at 1 psec per intensiUed dbt in a line 
or character and 1/2 ^tsec per unlntensiled dot, 
or off screen dot. Design improvements should 
allow reductions to 500 and 200 neec, respect-' 
ively. The present random point plot time of 
35 ^ec will also be reduced. 

EDGE VIOIiATlONS 

A description of a large problem can be con¬ 
tained at a console* During work on the pro¬ 
blem, a console user may want to have only 
a small portion of the total picture fill the 
scr eem He may want to move this area in- 
tereet, or window, smoothly about. During 
such actions, there may be picture pieces 
which are only partially contained on the CRT* 

It is partlcul 0 «"^y important in a satellite con¬ 
sole that edge violations from window move¬ 
ment be easily and appropriately handled. 

Extra space for a separate display list and 
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crpppiriL^ program and the processing of the 
total data base for every minute movement 
Bhould not be necessary. Instead^ edge vio¬ 
lations should be handled dynamically as they 
occur. 

The dynamic handling of physical ec^e 
violations is generally called "scissorir^- 
The common approach to achieve scissoring 
IB to represent picture parts by incrementally 
specified llnes^ points, and characters. Then 
if these incremental movement comman<^ 
cause a scope boundary to be croesed, the 
CRT beam ia blanked until the boundary is 
crossed In the opposite direction, at which 
time the picture ^ain is on the screen. Extra 
bits in the X and in the Y coordinate registers 
are used to detect scope edge viol^ons (3, 

14,15). Dot intensification does not take place 
unless the extra bits in both coordinate reg¬ 
isters are a3i zero. A picture thus '"wraps 
around" when only the leaM significant bits of 
the coordinale registers are considered hut is 
intensified normajy or totally blanked under 
control of the extra bits. Overflows or under^ 
flows of the extra bits generate computer Inter¬ 
rupts. Programs are then used to handle these 
situations* 

The edge-handling scheme used in 
GRAPHIC-3 is kindred to these techniques» 
Instead of extra bits ju the coordinate regis¬ 
ters, however^ a program settable switch de¬ 
termines whether the display is blanked or 
normal beam intensification t^es pl^e* The 
con^uter is signalled every time an edge is 
violated and sets the status of this override 
switch before resuming the diaplay, ttiIii 
approach is less expensive in hardware than 
having extra register bits. Even with the extra 
bits approach, prc^ramming must be present 
for underflows or overflows of these. Always 
using this underflow-overflow type of pro¬ 
gramming makes for a consistent symm^rical 
approach. 

Two software registers are used to accum¬ 
ulate the edge violations, L e., one register Is 
incremented for each right edge violatLos and 
decremented for each left edge violation, and 
another register Is tised similar]^ for tc^ and 
bottom edge violatione. The edge-handlhig 
routine d^ermines if both roisters are zero, 
and if so, the current point, line, or character 
being generated should appear on the screen. 

If not, the picture is off the screen* So the 
sc<^e hardware rasters serve as the low- 
order ten,bits of X and Y coordinate registers, 
the high-order bits of which are contain^ in 
software registers of any desired size* In 
practice^ one 18-blt register for each axis has 
been set aside for the e^a bits, allowing 
scissoring over a al®x2^“ area. 

INTERPRETIVE OPERATION O F THE CONSOLE 

As previously emphasized, it is important 
to be able to display structure information 
locaHy * This is achieved in the GRAPHIC-2 


system throt^h intimate cooperation of the 
PDP-9 proc^sor and the display processor* 

The processor performs the primitive 

operation such as drawing points, hues, char¬ 
acters, and setting display parameters. The 
display trap words call upon the PDP-9 to per¬ 
form the control operations analogous to direct 
and subroutine transfers. 

One might argue that such extensive dem¬ 
ands should not be placed upon the PDP-0 in 
rumii^ the display* The computer should be 
free for handling other tasks. Also specialized 
hardware is generally faster than interpretive 
software so that more material might be Re¬ 
play ed flicker-free U hardware transfer were 
us^. The specialized hardware approach Is 
being taken with some current displays (14,15), 

Experlffice with the GRAPHIC-1 console has 
shown, however, that if not involved In running 
the display^ the computer processor really Is 
idle. On the other hand, using the computer 
processor to help in runniug the display reduces 
the complexity and cost of the display electron¬ 
ics, allows a hierarchical data structure to be 
displayed directly, and allows a pushdown stack 
of display structure to be maintained dyuamlc^ 
ally, when appropriate, so that light pen strikes 
are easily serviced. 

The amount of flicker-free picture that can 
be displayed is no* significantly affected by inter¬ 
pretive operation since operation of the PDP-9 
processor and the display processor are over¬ 
lapped* To see how the structure level is 
dynamically traced in overlap operation, let 
ns begin by considering Fig* 3* 



Herep a typical picture structure as used in 
GRAPHIC-2 is illustrated (10)* This is a 
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directed graph structure in which there are sev¬ 
eral ^es of entitles. The circles r^resent 
nodes; the straight lines with arrows, branches; 
and the squares, terminal nodes or leaves. The 
nodes represent particular suhparts of a pic¬ 
ture. The branches are references to lower- 
level subparts of the picture. By convention, 
only the leaves contain display able material 
which is represented in display processor code 
formats. The related data structure in the 
central computer also conforms to the con¬ 
straint of having display able material only in 
the leaves, although this information is not 
represented hy display codes. So nodes and 
branches represent structure; leaves, picture 
elements. Display is accomplished as follows. 
The console computer traces down from the 
display node which heads each picture until it 
reaches a leaf. The display processor is 
started on displaying the leaf. In the mean¬ 
time, the console computer traces through the 
structure to find the next leaf. Position offsets 
between leaves are added up digitally during 
the structure tracing. When the display pro¬ 
cessor hits the dispw trap word marking the 
end of a leaf, the computer processor senses 
this and sets the display to the starting 
position of the leaf, gives the display processor 
the place in memory where the new leaf is 
located, and restarts the display. The console 
computer now traces through the structure to 
locate the next leaf, etc. If a light-pen hit 
occurs during a display frame, the console 
computer ceases overly operation during the 
next frame and instead dynamically maintains 
a pushflown list of the path structure, updating 
this list between leaves. When a light-pen hit 
occurs in this frame, the complete structure 
path name leading to that leaf is immediately 
available. Overlap operation is resumed on 
the next frame. 

The light pen can be used to point at a 
particular leaf in the picture structure. Pro¬ 
gramming techniques are used to hlinlt the 
selected leaf or higher level structures con¬ 
taining the leaf. The place in the data 
structure of the currently considered leaf is 
thus made apparent to a user. This type of 
visual feedbMk has proven valuable, if not 
essential both in the GRAPHIC-2 and else¬ 
where (16). 

During overlap operation, the structure 
tracing for a new leaf is often finished well 
before the display of the previous leaf. There¬ 
fore, a Eunimum of time is needed to start 
the display processor on a new leaf. Extra 
time is required only during a light-pen inter¬ 
pretation frame. Contrast the interpretive 
mode to the operation of fixed hardware which 
must take the time for all the structure trying 

addition of position offsets in series with 
display time each frame. For heavily struct¬ 
ure displays, the gains of overlapped inter- 
pr^ive operations can be significant. 

Aside from handling leaf ends, display 
trap programs are used to perform data- 


structure manipulations every display regen¬ 
eration cycle. Examples of this type of pro¬ 
gram are a "move" program to cause an 
ob] ect on the CRT to follow the light pen, and 
a "rubber-band line" drawing program. Another 
use is function generation using the accumulator 
path as outlined earlier. Still other uses are to 
change the character table pointer so that sev¬ 
eral character fonts appear in a picture and to 
inqjlement the carriage return character fun¬ 
ction. 

COMMENTS 

Although in the GRAPHIC-3 soft ware system 
the display handling proceeds without the exact 
software dig)lication of current hardware tech¬ 
niques, there is nothing to prevent such use. 

The display trap programs could easily perform 
conventional direct transfers and subroutine 
transfers and return (-with status saving and 
restoring) or any other operations. Other 
software systems might employ the flexibility 
and power of display trap techniques in as yet 
unconceived ways. The ability provided by dis- 
pl^ trap words to cause console computer 
programs to be executed at specified places 
in the display cycle is another step in the con¬ 
tinuing development of more powerful display 
techniques. These techniques began with 
displays run from lists through the computer 
accumulator, moved to linear lists out of a 
channel, then to hardware subroutining, and 
now to extensive intermixed pr^rammii^. 

The satellite console oiganixalion seems to 
be finding increasing favor. Older console 
systems are being modified (17), the large 
siqjpliers are joining some standard pieces 
to form such a system (18,19), and entirely new 
consoles (20) and systems (21) are being de¬ 
signed. If is hoped that the ideas beijc^ pione¬ 
ered by the GRAPHIC-2 system wiU be useful 
in these new systems, 
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